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This PBIS school status report provides a summary of 
the current status of all schools implementing PBIS in 
Minnesota, including participation in the Minnesota 
Department of Education’s training sequence, 
implementation fidelity assessment scores, and outcomes 
(as appropriate). In particular, this report highlights the 


implementation Regions 


patterns and trends in PBIS implementation and @® north 
outcomes in Minnesota, and helps to understand the @® south 
relationships between training, implementation fidelity, ae 
and outcomes. This report is intended for all stakeholders 
to better understand the status of PBIS in Minnesota. 
About PBIS Schools 
Number of schools (by cohort) 
Number of schools (by region) Cohort Number 
Number __ Percent (year school of 
Metro 187 51% entered training) Schools 
North 108 29% 1 (2005) 9 
South 72 20% 2 (2006) 10 
Total 367 100% 3 (2007) 44 
4 (2008) 32 
Number of schools (by grade level) 5 (2009) 46 
Number _ Percent 6 (2010) 76 
Early childhood 4 1% 7 (2011) 76 
Elementary 196 53% 8 (2012) TT 
Middle school 56 15% 367 100% 
High school 51 14% 
Early childhood/elementary 1 0% 
Early childhood-8th 1 0% Training indicators — only for schools 
K-8 4 1% currently in the 2-year sequence 
K-12 16 4% 
Middle school/high school 8 2% For schools that are currently participating in the 2-year 
ALC rv 3%; PBIS training sequence sponsored by the Minnesota 
Department of Education, three indicators are used to 
Other 1 0% ; eae : ; 
illustrate how fully schools are participating and invested in 
inaeivellosed ul aM the training: team attendance at training, administrator 
Total 367 100% 


participation at training, and usefulness of training. 


Team attendance and administrator participation at training 
Schools in the first year of training in 2012-13 (Cohort 8) 


had six full days of training that they are expected to attend. 


Schools in the second year of training in 2012-13 (Cohort 
7) had three full days of training. Support from 
administration is a key feature of schools that successfully 
implement PBIS. Schools that are participating in the 2- 
year training sequence are expected to bring an 
administrator (principal, vice-principal, or assistant 
principal) to training. 


Average number of training days by team and administrator 
(Cohort 7 - Year 2 in training sequence, max.=3.0 days) 


2.9 3.0 
24 


2.8 2.8 2.9 


2.4 2.3 


Metro North South State 
(N=39) (N=11) (N=17) average 
(N=67) 
a Team = Administrator 


Average number of training days by team and administrator 


6.0 6.0 6.0 6.0 6.0 
5.6 
4.8 wa 
Metro North South State 
(N=35) (N=21) (N=16) average 
(N=75) 


a Team «= Administrator 


(Cohort 8 - Year 1 in training sequence, max.=6.0 days) 


Usefulness of training 

Schools are asked to provide feedback on the training 
sessions they attended. Participants were asked how 
much they agree or disagree with the following 
statement: “Overall, this training was a positive, 
worthwhile learning experience.” The graph below 
illustrates ratings from the fall, winter, and spring 
trainings for the 2012-2013 school year. 


“Overall, this training was a positive, worthwhile learning 
experience.” (Combined results, all trainings in 2012-13). 


4% 2% 4% 2% 1% 
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Implementation fidelity measures 


PBIS is an evidence-based approach to addressing behavior 
issues in schools. A significant amount of research has 
been done to identify the critical features of PBIS. More 
generally, implementation science points to a specific 
sequence to ensure the model is implemented with fidelity. 
The following assessment tools are used to assess PBIS 
implementation fidelity among participating schools in 
Minnesota. 


SET scores 

The School-wide Evaluation Tool, or SET, is used to 
measure implementation fidelity of tier 1 (universal tier) 
of PBIS. At the beginning of their training sequence, 
schools are asked to complete a baseline SET, which is 
administered by a trained SET Evaluator who is from 
outside the school. This baseline score is an indication of 
how much work the school has to do to get from where 
they are currently at to full implementation of PBIS. 


Average SET scores for Cohorts 1-6 (Schools out of training) 


82 
Not 
available 
Post - Year 1 Post 
(Not available) (Spring 2013) 
(N=18) 


Note: Historical data for Cohorts 1-6 are not readily available to calculate scores at 
Baseline or for Post-Year 1. 
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Average SET scores for Cohort 7 
(Schools in year 2 of training sequence) 


il 


Baseline Mid year - Year Post - Year 2 
(Fall 2011) 1 (Spring 2012) (Spring 2013) 
(N=24) (N=64) (N=56) 


Average SET scores for Cohort 8 
(Schools in year 1 of training sequence) 


; : aide 


Baseline Mid year - Year Post - Year 2 
(Fall 2012) 1 (Spring 2013) (Spring 2014) 
(N=65) (N=67) 


Team Implementation Checklist 

The Team Implementation Checklist, or TIC, is a tool 
used by schools to measure PBIS implementation 
fidelity. The TIC is supposed to be completed by the 
PBIS team three times per year to monitor activities for 
implementation of PBIS in a school. Only TIC scores 
from the most recent school year are included. 


Number of TICs completed during last school year 
(by cohort) 


1% 


All cohorts Cohorts 1-6 Cohort 7 Cohort 8 
(N=367) (N=214) (N=76) (N=77) 
sOTICS w1TIC w2TICS «3+ TICS 


Self-Assessment Survey 

The Self-Assessment Survey, or SAS, examines the status 
and need for improvement of four behavior support systems: 
school-wide, non-classroom, classroom, and individual 
students. A summary of the SAS results should be used to 
develop an action plan for implementing and sustaining 
PBIS systems throughout the school. The SAS should be 
completed by teams in training twice during their first year 
and once during their second year of training. 


Number of SAS completed during last school year (by cohort) 


no, eS 
i 


Cohorts 1-6 Cohort 7 Cohort 8 All cohorts 
(N=214) (N=76) (N=77) (N=367) 
=0SAS =1SAS =2+ SAS 


Benchmarks of Quality 

Benchmarks of Quality, or BoQ, is a self-assessment tool 
that schools use to assess implementation fidelity of tier 1 
of PBIS. In Minnesota, schools that have reached a score 
of 80+ on the SET and have completed the 2-year training 
sequence are eligible to complete the BoQ every year for 
two years and then they only need to complete a SET 
every third year. Therefore, being eligible to complete the 
BoQ is an indication of implementation fidelity. Only BoQ 
scores from the previous school year are included. The 
majority of schools that completed the BoQ are implementing 
PBIS with fidelity (as indicated by a score of 70 or more). 


BoQ score of Cohorts 1-6 that qualified to complete the BoQ 
(2012-2013 school year) 


51% 


>60 points 60-69 points 70+ points Qualified, 
(N=2) (N=7) (N=48) but did not 
complete 

(N=60) 
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Behavioral data system 

The presence of a behavioral data system allows for 
data-based decision making. The data collected in these 
systems are used for improving school-wide behavior 
support. Most schools in Minnesota that are doing PBIS 
use SWIS, but a significant minority use other systems. 


Behavioral data system used (Cohorts 1-6 and 7-8) 


63% a Cohorts 1-6 


= Cohort 7-8 


56% 


24% 


System SWIS Non- 
unknown (N= 120, 96) SWIS 
(N= 54, 9) (N= 34, 36) 


Note: Non-SWIS=School uses one of the following systems: TIES, Infinite Campus, 
CLASSROOM, SKYWARD, or a custom system. For schools that are considered to 
be “Inactive”, it is unknown what type of behavioral data system is used. 


Outcomes — Triangle data 


One goal of PBIS is to increase the efficiency with 
which schools can respond to students’ behavioral 
support needs (Sailor, Dunlap, Sugai, & Horner, 2009). 


Triangle data (Statewide, N=127) 
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Triangle data (Metro, N=74) 
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This efficiency can be maximized by minimizing the number 
of students who need support beyond the universal level. 


The hallmark conceptual triangle of PBIS suggests that, on 
average, 80-90% of students are socially successful with 
universal support alone, 5-10% require additional support in 
the form of targeted interventions, and 1-5% require intensive 
individualized support (Sugai, Horner, & Gresham 2002). 
Based on this, Minnesota schools that have been trained to 
implement PBIS are, on average, within the targets. 


The smaller the percentage of students who require support 
beyond the universal level, the more efficiently those 
students can be served with the limited resources schools 
have available. “Socially successful” is defined as having 
0-1 office discipline referrals (ODR) within a given time 
span, while “needing targeted interventions” is defined as 
having 2-5 ODR, and “needing intensive interventions” as 
having more than 6 ODR within a given time span (Horner, 
Sugai, Todd, & Lewis-Palmer, 2005). 


Data are reported for schools in cohorts 1-6 that have 
completed the two-year training sequence and that have 
entered data through SWIS. The triangle scores are calculated 
using “Majors only.” Major behaviors are defined as 
disciplinary incidents that must be handled by administration. 
These may include, but are not limited to: physical fights, 
property damage, drugs, weapons, tobacco, etc. 


Triangle data (North, N=30) 
__17% 
~ 112% 


Triangle data (South, N=23) 
__13% 
«(1 8% 
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For more information 


For more information about this report, contact Nicole 
MartinRogers at Wilder Research, 651-280-2682. 
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